AD-A080  114 


CALIFORNIA  UNIV  BERKELEY  OPERATIONS  RESEARCH  CENTER  F/6  12/2 

SCHEDULING  JOBS  SUBJECT  TO  N0NH0M06ENE0US  POISSON  SHOCKS. (U) 

NOV  79  M  L  PINEDO»  S  M  ROSS  N00014-77-C-O299 

UNCLASSIFIED  ORC-79-1* 


fcOAOSOU  4 


ORC  79-14 
NOVEMBER  1979 


SCHEDULING  JOBS  SUBJECT  TO  NONHOMOGENEOUS  POISSON  SHOCKS 


MICHAEL  L.  PINEDO 


SHELDON  M.  ROSS 


-7  r-j.:  *3  r:  f*5® 

i  i*  1  %  ’ 


ttas&oi  U 


i  r.  k 


OPERATIONS 

RESEARCH 

CENTER 


'•  ‘T’  ’JtIoN  statement  a 

n  -  -?d  for  public  ieleaa«J 
.  ution  Unlimited 


D  D  C 

t|\12i2EDILQC 

ki  FEB  I  B0O 


I 


UNIVERSITY  OF  CALIFORNIA  ^-BERKELEY 


oo 


SCHEDULING  JOBS  SUBJECT  TO  NONHOMOGENEOUS  POISSON  SHOCKS 


by 


Michael  L.  Pinedo 
Centro  de  Ingenieria  y  Computacion 
Instituto  Venezolano  de  Investigaciones  Cientificas  (IVIC) 

Caracus,  Venezuela 

and 

Sheldon  M.  Ross 

Department  of  Industrial  Engineering 
and  Operations  Research 
University  of  California,  Berkeley 


accs - sion  i 
;  riS 


A 


NOVEMBER  1979  ORC  79-14 

This  research  has  been  partially  supported  by  the  Office  of  Naval 
Research  under  Contract  N00014-77-C-0299  and  the  Air  Force  Office  of 
Scientific  Research  (AFSC) ,  USAF,  under  Grant  AFOSR-77-3213B  with  the 
University  of  California.  Reproduction  in  whole  or  in  part  is  per¬ 
mitted  for  any  purpose  of  the  United  States  Government. 


_ _ Unclassified _ 

Cl  assi  pi  cation  or  this  pace  (Whan  Data  Bntarad) _ 

jV  J  REPORT  DOCUMENTATION  PAGE 

l>X*EPORT  NUMBER  II.  GOVT  ACCESSION  WO. 

ORC— 79-14  j  ^ 

i  TiTLe  (and  Submit)  / 

J  SCHEDULING  JOBS  SUBJECT  TO  NONHOMOGENEOUS  V _ ^ 

\  POISSON  SHOCKS  -  ^  / 

1-^ _ _ _ I  ^ 

~>r  AUTHOPf'l)  ~ "  ~  ^ 

jy^ichael  L.j  Pinedo  aad  Sheldon  M.  |Ross  j _ 

»  PERPORMING  organization  name  ANO  AOORESS  , 

Operations  Research  Center  J  /y/ 

University  of  California 
Berkeley,  California  94720 
ii.  controlling  oppice  name  ano  adoress 

United  States  Air  Force  /  /  J 

Air  Force  Office  of  Scientific  Research  -  " 
Bolling  AFB,  D.C.  20332 _ 

U  monitoring  AGENCY  NAME  >  AOORESSfU  dlllaragl  /few  Controlllnt  Ottlcb) 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 
1.  RECIPIENT'S  CATALOG  NUMBER 


I  Research  Report v 

r  PERPORMING  ORC.  REPORT  NUMBER 
BBNPRALI  URURARI  ~WUWBCRf*J  T" 

■  '  -  w  r  '  F  •  i  / 

^  AFOSR-77-3213*  ^ 


PROGRAM  ELEMENT.  PROJECT,  TASK 
AREA  •  WORK  UNIT  NUMBERS 


2304/A5 

era 


Novaafacr  1979 

U.JNUMBER  OP  PACES 

20 _ 

IS.  SECURITY  Class,  (a I  Ih la  raport) 

Unclassified 


So.  OECL  ASSIPlC  ATI  ON/  SOWN  GRADING 
SCHEDULE 


[IS.  DISTRIBUTION  STATEMENT  (of  Ull«  Raport) 


Approved  for  public  release;  distribution  unlimited. 


I  17.  DISTRIBUTION  STATEMENT  (ot  tha  obatract  antarad  In  Block  30,  II  d!  t  tar  ant  from  Raport) 


IS.  supplementary  notes 

Also  supported  by  the  Office  of  Naval  Research  under  Contract 
N00014-77-C-0299. 


19.  KEY  WORDS  (Continue  on  r«rtr««  aide  if  naceaae ry  and  Idantity  by  block  number) 

Scheduling 

Shocks 

Nonhomogeneous  Poisson  Process 
Failure  Rate  Ordered 

20.  ABSTRACT  (Contfnuo  on  raver  ae  aid a  If  nacaaaary  and  identify  by  block  number) 

(SEE  ABSTRACT) 


DO  ,:rn  1473  EDITION  OP  I  NOV  SS  It  OBSOLETE 
S/N  0102-LF-014-6401 


5  7 0  7 50 


Unclassified 

SECURITY  CLASSIPICATION  OP  THIS  PACE  fWtiwi  Data  Knl and) 


Consider  n  jobs  which  have  to  be  performed  sequentially  in  time. 
There  are  external  shocks  which  occur  according  to  a  nonhomogenous 
Poisson  process.  If  a  shock  occurs  during  the  performance  of  a  job, 
then  work  on  that  job  ends  and  work  on  the  next  one  commences.  A 
job  is  successfully  performed  if  no  shocks  occur  during  its  execution 
time.  We  consider  such  problems  as  maximizing:^ 


(i)(j)The  expected  number  of  successful  job  performances; 
(ii-V^The  length  of  time  until  no  jobs  remainu^*. 

(i^i)^3)The  expected  total  reward  earned;  where  a  reward 

is  obtained  upon  successful  completion  of  job  i  .  — ^ 

We  determine  conditions  on  the  distribution  of  job  performances  which 
result  in  simple  policies  being  optimal. 
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SCHEDULING  JOBS  SUBJECT  TO  NONHOMOGENEOUS  POISSON  SHOCKS 


by 

Michael  L.  Plnedo  and  Sheldon  M.  Ross 

1.  INTRODUCTION  AND  SUMMARY 

Suppose  Chat  n  jobs  have  co  be  performed  sequentially  In  time  - 
the  i1"*1  job  requiring  a  random  time  for  its  execution.  In  addition, 

suppose  there  are  external  shocks  which  occur  according  to  a  non- 
homogeneous  Poisson  process.  If  a  shock  occurs  during  the  performance 
of  a  job  then  work  on  that  job  ends  and  work  on  the  next  one  commences. 

A  job  is  said  to  be  successfully  performed  if  no  shocks  occur  during  its 
execution  time. 

We  are  interested  in  determining  the  job  schedule  that  maximizes 
the  expected  number  of  successful  job  performances.  However,  as  a  means 
to  determining  this,  we  shall  first  consider  the  related  problem  of 
stochastically  maximizing  the  length  of  time  until  all  jobs  are  finished 
(either  successfully  or  by  shocks).  This  related  problem  is  of  in¬ 
dependent  interest  for,  by  interpreting  the  n  jobs  as  being  n  spares 
in  a  stockpile,  it  becomes  one  of  stochastically  maximizing  the  life  of 
a  stockpile  of  spares  which  are  subject  to  shocks  which  kill  any  spare 
in  use  when  the  shock  occurs. 

The  related  problem,  without  any  assumption  of  external  shocks, 
but  under  the  condition  that  the  lifetime  of  a  spare  depends  on  its  t  me 
of  installation  has  previously  been  studied  in  [  1  ]  and  [  2  ] .  Brown  and 
Solomon  [  2  ]  established  optimal  schedules  for  certain  cases  in  which  the 
lifetimes  of  the  spares  are  monotone  likelihood  ratio  ordered. 


In  this  paper  we  consider  a  more  general  ordering  chan  monotone 
likelihood  racio  ordering.  This  ordering,  which  we  call  failure  race 


2 


ordering,  implies  stochastic  ordering.  We  show  in  Section  3  that  if  the 
lifetime  distributions  are  failure  rate  ordered  and  if  the  intensity 
function  of  the  Poisson  process  is  increasing,  then  in  the  related  stock¬ 
pile  problem,  the  strategy  of  issuing  spares  is  decreasing  order  of  their 
means  stochastically  maximizes  the  system  life  and  in  the  original  prob¬ 
lem,  the  strategy  of  issuing  jobs  in  increasing  order  of  their  means 
maximizes  the  expected  number  of  successful  jobs.  Also,  when  the  intensity 
function  of  shocks  is  decreasing,  the  optimal  strategy  is  to  reverse  the 
order  given  above. 

In  Section  4  we  suppose  that  the  execution  time  of  job  i  is  ex¬ 
ponentially  distributed  with  rate  and  that  a  reward  is  earned 

if  job  i  is  successfully  performed,  i  *  1,  ....  n  .  We  show  that 
if  the  intensity  function  of  shocks  is  increasing  then  1,2,  ...,  n 
is  the  optimal  strategy  if  both  and  are  decreasing  in  i  . 

If  the  intensity  function  of  shocks  is  decreasing  then  n,n  -  1,  ...»  1 
is  the  optimal  strategy  if  both  R^  and  A^R^  are  decreasing  and 


is  increasing  in  i  . 


2.  DEFINITIONS  AND  PRELIMINARY  RESULTS 

Two  random  variables  and  X2  are  said  to  be  increasing  failure 

rate  ordered  if 

?!<(:) /^(s)  >_  F2(t)/F2(s)  for  all  s  <  t 

where  F^Ct)  ■  P{X^  >  t}  .  Given  a  collection  of  pairwise  failure  rate 
ordered  random  variables  we  can  reorder  them  such  that  X^  and  X^  are 
increasing  failure  rate  ordered  if  i  <  j  .  We  call  such  a  collection 
increasing  failure  rate  ordered. 

If  the  X^  are  continuous  with  densities  f^  then  the  failure  rate 
function  r^  of  X^  is  defined  by  r^Ct)  *  f^(t)/F^(t)  .  The  following 
lemma  justifies  our  terminology. 

Lemma  1: 

The  continuous  random  variables  X^  and  X2  are  increasing  failure 
rate  ordered  if  and  only  if  r^(t)  <_  r2(t)  for  all  t  . 

Proof : 

Using  the  well  known  identity 


we  have  that 
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and  so  if  X^  and  X2  are  increasing  failure  rate  ordered  then 


w  w 

j  r1(y)dy  1  r2<y)dy  for  all  s  , 


implying  that  r^(y)  <_  r^iy)  •  The  converse  also  follows  by  reversing 
the  argument. | | 


Two  continuous  random  variables  X^  and  X2  are  said  to  be  increasing 
monotone  likelihood  ratio  ordered  if  for  s  <  t 


f2(t)/f1(t)  >  f2(s)/f1(s) 


From  the  definition  of  monotone  likelihood  ratio  ordering  we  have 


J  (f  2 (t) f ^ (s)  -  f2(s)f1(t))dt  >.  0  for  all  s 


or,  equivalently 


r^s)  >_  r2(s) 


As  it  easily  follows  that  failure  rate  ordering  implies  stochastic 


ordering  from  the  identity  F(t)  *  exp  <-  f  r(s)ds>  we  see  that  monotone 

(  0  ) 

likelihood  ratio  ordered  failure  rate  ordered  stochastic  ordered. 


3.  RESULTS 


We  consider  a  stockpile  of  n  spares  in  which  the  i^1  spare  has 
lifetime  X^  .  We  have  a  one  component  system  subject  to  shocks  which 
occur  according  to  a  nonhomogenous  Poisson  process  with  intensity  function 
v(t)  .  A  spare  has  to  be  replaced  when  it  fails  as  the  result  of  its 
internal  lifetime  or  as  the  result  of  a  shock. 

Theorem  1; 

Given  n  spares  with  lifetimes  X^,  ....  Xr  which  are  increasing 
failure  rate  ordered  and  given  that  the  rate  v(t)  of  the  shocks  is 
increasing  (decreasing)  over  time,  then  the  schedule  1,2,  ...,  n 
(n,n  -  1 . 1)  stochastically  maximizes  the  lifetime  of  the  system. 

Proof : 

We  will  prove  only  the  case  where  v(t)  is  increasing  over  time, 

as  the  proof  for  v(t)  decreasing  is  identical. 

First  we  consider  the  case  n  *  2  .  To  show  the  probability  that  system 

life  will  last  until  time  t  is  larger  using  the  alleged  optimal  schedule, 

we  condition  on  the  number  of  shocks  that  occur  before  time  t  .  If  there 

are  zero  shocks,  both  schedules  will  yield  the  same  probability.  If  there 

are  two  or  more  shocks  before  time  t  ,  the  probability  will  be  zero  under 

both  schedules.  So  it  suffices  to  consider  the  case  in  which  only  one 

shock  occurs  before  time  t  ,  because  only  then  will  there  be  a  difference 

between  the  two  schedules.  If  P^(x)  denotes  the  probability  that  this 

x  t 

shock  occurs  before  time  x  (x  <  t)  ,  then  P1 (x)  -  f  v(s)ds/  f  v(s)ds  . 

1  0  0 

Letting  (02)  denote  the  conditional  probability  that  the  system 

will  function  until  time  t  ,  given  only  one  shock  occurs  and  using  schedule 
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W 


a,  »  |  F, (x)F2(t  -  x)v(x)dx/  |  v(s)ds 


h 


and 


l. 

J  ^(x)^ 


(t  -  x)v(s)ds/  I  v(s)ds 


/ 


Hence  we  must  show 


or. 


/ 

0 

t 

t/2 

equivalently, 


[F1(x)F2(t  -  x)  -  F2(x)F1(t  -  x) ]v(x)dx 


[F2(x)F1(t  -  x)  -  F1(x)F2(t  -  x) ]v(x)dx 


t 

j  [F2(x)F1(t  -  x)  -  F2(t  -  x)F^(x) ] [v  (t  -  x)  -  v(x)]dx  >_  0  . 
t/2 

Now  in  the  range  of  integration  v(x)  ^v(t-x)  ,  so  the  inequality  holds  if 
?1(x)F2(t  -  x)  <_  F2 (x)F^ (t  -  x) 


which  follows  since  X^  and  X2  are  increasing  failure  rate  ordered. 
This  completes  the  proof  for  the  case  n  ■  2  . 

We  will  now  show  that  system  life  under  arbitrary  schedule 
1,,2,,3',  . ..,  m'  is  stochastically  larger  than  system  life  under 
schedule  2,,1,,3',  . . . ,  m'  if  E(X^f)  >  E(X2,)  .  Let  t^  be  the  time 
epoch  of  shock  i  .  Condition  on  t^  ,  i  ■  1,2,3,  ...  ,  and  on  the  life¬ 
times  of  the  spares  3' ,4* 


»  •  •  •  f 


m'  .  Now  let  G(s)  be  the  conditional 


7 

lifetime  of  the  system  given  that  the  third  spare  is  installed  at  time 
epoch  s  and  the  subsequent  spares  are  installed  according  to  the  schedule 
3', 4',  m'  .  We  will  show  that  G(s)  t  s  .  We  first  note  that  the 

third  spare  (with  lifetime  X^,)  will  be  installed  at  time  epoch  s  . 

Suppose  the  next  shock  occurs  at  time  epoch  w  .  Then  the  next  spare 
will  be  installed  at  time  epoch  s  +  min  (X^,,w  -  s)  .  This  last  expression 
is  nondecreasing  in  s  .  Repeating  this  argument  proves  G(s)  +  s  . 

From  the  case  n  •  2  ,  we  know  the  time  the  third  spare  will  be  installed 
is  stochastically  larger  under  schedule  l',2'  .  As  stochastic  ordering  is 
preserved  under  monotone  transformations  the  conditional  system  life  under 
schedule  l'^'^',  . . . ,  m'  is  stochastically  larger  than  under  schedule 
2,,1,,3',  ....  m'  .  Unconditioning  gives  the  desired  result. 

From  this  we  easily  can  obtain  a  more  general  result:  the  system  life 
under  arbitrary  schedule  l',2',  i'.j'jk',  n'  is  stochastically 

larger  than  under  schedule  l',2',  i',k',j',  ....  n'  if  E(X^f)  >  E(X^,) 

This  can  be  shown  by  conditioning  on  the  time  epoch  spare  i'  dies  and 
using  the  preceding  results. 

As  any  schedule  can  be  transformed  through  pairwise  switches  into 
schedule  1,2,  ...,  n  in  such  a  way  that  each  pairwise  switch  gives  an 
improvement  in  the  lifetime  of  the  system,  it  is  clear  that  schedule 
1,2,  ...,  n  is  the  optimal  schedule. | | 

In  exactly  the  same  way,  we  can  also  prove  that  the  reverse  schedule 
to  that  given  in  Theorem  1  stochastically  minimizes  the  lifetime  of  the 
system.  That  is,  we  have 
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Corollary  1: 

Under  the  conditions  of  Theorem  1,  if  v(t)  is  increasing  (decreasing) 
then  the  schedule  n,n  -  1,  . ..,  2,1  (1,2,  ....  n  -  l,n)  stochastically 

minimizes  the  lifetime  of  the  system. 

We  are  now  in  position  to  prove 


Theorem  2: 

Given  n  spares  with  lifetimes  X^,  ....  X^  which  are  increasing 
failure  rate  ordered  and  given  that  the  intensity  rate  v(t)  of  shocks 
is  increasing  (decreasing)  over  time,  then  the  schedule  n,n  -  1,  ....  1 
(1,2,  ....  n)  maximizes  the  expected  number  of  successful  job  performances. 


Proof : 

Let  N(t)  denote  the  number  of  shocks  by  time  t  and  for  any 
schedule  tt  let  L  denote  the  system  life  under  policy  ir  .  Now 

7T 

(  c  ) 

N(t)  -  /  v(s)ds  is  a  Martingale  with  0  mean  and  as  is  a  stopping 

time  having  a  finite  expected  value,  it  follows  from  Martingale  theory 
that,  for  any  schedule  x  , 


E 


NO.,) 


I 


v(s)ds 


0 


or 


E[N(LT)]  =  E 


II 

/ 


v(s)ds 


o’— >x 
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Now  letting  it*  denote  the  allegedly  optimal  policy  it  follows  from 
Corollary  2  that  is  stochastically  smaller  than  and  as 

v(s)ds  is  a  monotone  function  of  x  it  follows  that 


L  * 

L 

7] 

IT 

<• 

E 

1  v(s)ds 

J 

£  E 

1  v(s)ds 

J 

_  0 

_0 

implying  that 


E[N(L  *)  <  E[(L  )]  . 

IT  —  IT 

The  result  now  follows  since  N(L^)  is  just  equal  to  n  minus  the 
number  of  successful  job  performances.il 

Remarks : 

1.  It  may  be  assumed  that  each  time  a  spare  (or  job)  is  installed 
the  decision-maker  knows  the  lives  of  the  previous  installed 
spares  (or  jobs).  Conceivably  he  may  take  this  into  account 
at  each  stage  in  deciding  which  spare  to  install  next.  We  claim 
that  our  schedules  remain  optimal  even  among  the  larger  class 
of  policies  which  allow  the  decision-maker  to  operate  sequentially. 
To  see  this  we  argue  as  follows:  If  there  is  one  spare  left, 
there  is  no  decision  to  be  made.  When  there  are  two  spares  left, 
our  claim  is  obviously  true.  When  there  are  three  spares  left, 
we  know  that  whichever  spare  is  installed,  independent  of  its 
lifetime,  the  last  two  spares  will  be  installed  according  to 
our  imai  policy.  The  objective  is,  to  choose  the  spare  which 


combined  with  the  last  two  spares  (ordered  according  to  our 
optimal  schedule)  gives  the  largest  total  lifetime.  So  if  we 
operate  sequentially,  our  decision  with  three  spares  left  will 
result  in  the  same  schedule  as  when  we  do  not  operate  sequen¬ 
tially.  Repeating  this  argument  for  a  larger  number  of  spares 
completes  the  proof. 

2.  If  the  distributions  of  the  lifetimes  of  the  spares  are  merely 
stochastically  ordered,  then  the  schedules  described  in 
Therems  1  and  2  are  not  necessarily  optimal.  We  give  the 
following  counterexample.  Let 

(  10  ^  for  0  <  x  <  2 
v(x)  *  \ 

(0  x  >  2 

and  suppose  we  have  2  spares  with  lifetimes  X^  and  X2 
which  are  such  that 

1  with  probability  0.5 
3  with  probability  0.5 

2  with  probability  0.5 

3  with  probability  0.5  . 

Obviously  Xj  is  stochastically  larger  than  X^  ,  but  X^ 
and  X2  are  not  failure  rate  ordered.  The  schedule  which 
maximizes  the  expected  lifetime  of  the  system  is  2,1  .  This 
can  be  easily  checked  by  considering  the  case  of  only  one 
shock  occurring  in  [0,2]  ,  which  due  to  the  low  rate  of 
shocks  is  the  dominant  probability. 
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3.  One  possibility  we  have  not  allowed  for  is  for  a  still  func¬ 
tioning  spare  to  be  replaced  and  kept  in  the  stockpile  for  later 
use.  Let  us  assume  in  this  case  that  the  remaining  life  of 

the  spare  is  not  changed  by  such  a  preemption.  Then  our 
results  would  go  through  only  under  additional  conditions. 

Specifically  to  prove  that  the  given  schedule  in  Theorem  1  remains 
optimal  and  that  a  preemption  is  never  optimal  we  would  have  to 
assume  that  the  component  life  distributions  all  have  decreasing 
failure  rates  in  the  case  where  v(t)  is  increasing  and  all 
have  increasing  failure  rates  when  v(t)  is  decreasing. 

Similarly  in  Theorem  2  we  would  need  that  the  spares  all  had 
increasing  (decreasing)  failure  rates  in  the  case  where  v(t) 
increases  (decreases).  The  proof  follows  from  noting  that  under 
the  presumed  ordering,  at  any  time  a  preemption  is  contemplated 
the  remaining  lifetime  of  the  spare  to  be  preempted  is  still 
ordered  among  the  remaining  spares  in  the  same  way  as  originally. 

The  above  can  be  made  the  first  step  of  an  inductive  proof  which 
proves  the  result  when  at  most  k  preemptions  are  allowed. 

4.  Since  many  individual  spares  are  built  up  of  smaller  parts  it 
may  be  worthwile  to  note  that  a  k-of-n  system  in  which  each 
component  life  is  independent  and  has  the  same  life  distribution 
F  would  have  a  failure  rate  order  relationship  to  a  similar 
k-of-n  having  component  life  distributions  all  equal  to  G  , 
whenever  F  and  G  have  that  failure  rate  ordered  relationship. 

5.  Both  problems  could  also  be  analyzed  using  the  approach  of  Brown  and 
Solomon  [  2  ].  Using  their  lemma  1  on  the  case  n  *  2  results  in 

a  very  simple  proof.  However,  this  proof  is  only  valid  for  monotone 

j 


likelihood  ratio  ordered  and  not  failure  rate  ordered  distributions. 
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4.  EXPONENTIAL  LIFETIMES  AND  REWARDS 

In  this  section  we  suppose  that  ,  the  execution  time  of  job  i  , 

is  exponentially  distributed  with  rate  ,  i  -  1 . n  .  In  addition, 

we  suppose  that  a  reward  is  earned  if  job  i  is  successfully  per¬ 

formed. 

Denote  by  the  length  of  time  that  work  is  done  on  job  i  ,  i.e., 

it  is  the  length  of  time  from  the  beginning  of  work  on  job  i  until  work 
on  that  job  ends  either  because  it  is  completed  successfully  or  a  shock 
occurs.  We  then  have  the  following  result  from  Derman-Lieberman-Ross 
(Page  559  of  [3]). 

Lemma  2 : 

For  any  scheduling  policy  it 

n 

E  [Total  Reward]  •  7  A.R.E  [T. ]  . 

7T  i  i  it  i 

In  words.  Lemma  2  says  that  the  expected  return  is  the  same  if  one  received 

rewards  at  a  constant  rate  A^R^  whenever  job  i  was  being  performed. 

Lemma  3; 

If  v(t)  is  increasing  and  if  At  <  A^  and  A^  =  max  X^R^  ,  then 

the  total  expected  reward  under  schedule  i,j,k^,  . ..,  k  ^  is  larger  than 

the  total  expected  reward  under  schedule  j,i,k, ,  ...»  k  „  where 

1  n-Z 

k^ . ^n-2  Can  be  anjr  Permutation  of  the  remaining  n  -  2  jobs. 


Proof : 


Schedule  i,j,k^,  ...»  ^n_2  will  be  denoted  by  ir  ,  and 
j,i,k^,  ....  ^n_2  by  ir  *  .  According  to  Lemma  2,  it  suffices  to  show 
that 


n-2 


(1) 


VlMV  ♦  *  £  \V{\] 

i  WVV  *  W'V  *  "f  X^E^J 


Now  it  follows  from  the  proof  of  Theorem  1,  that  each  of  the  jobs 
j,k^,  ....  kR_2  will  be  started  at  a  stochastically  earlier  time  under 
ir'  than  under  it  .  Hence  as  v(t)  is  increasing  we  have  that 


(2) 


VV  -  and 


1. 


n 


2  . 


But  from  Theorem  1,  we  have  that 


(3) 


n-2 


MV  +  MV  +  E*[\] 

i^nj  +  ViV*  Ji  M[\]- 


Now  (2)  and  (3)  in  conjunction  with  the  condition 
all  k  establishes  (1).|| 


AiRi  -  Xk\ 


for 


We  now  have 
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Theorem  3: 

If  v(t)  Is  Increasing  and  if  Ri  and  are  decreasing,  then 

1,2,  ...,  n  is  the  optimal  schedule. 

Proof: 

The  proof  is  by  contradiction.  Consider  any  strategy  which  is  not 
in  decreasing  order  of  R  .  Suppose  the  job  with  the  highest  value 
of  R  (spare  1)  is  not  scheduled  first.  Suppose  the  job  which  imme¬ 
diately  precedes  job  1  is  job  k  . 

We  consider  two  cases: 


Case  1: 

R1  "  \  *  X1  "  Xk  and  X1R1  "  Xk\  • 

According  to  Lemma  3,  interchanging  job  1  and  job  k  increases 
the  total  expected  reward. 


Case  2: 


R^  >  and  >  \  ‘  Let  denote  the  probability  that 

job  i  is  successfully  performed  under  the  original  schedule  and  let 
P^ir')  denote  the  probability  that  job  i  is  successfully  performed 
under  the  schedule  obtained  after  performing  the  pairwise  switch  between 
jobs  k  and  1  .  Now  since  v(t)  is  increasing,  we  have  that 


P1(n)  >  PiCir’ ) 


and  from  Theorem  2,  we  have 


Pl(?r)  +  Pk(7r)  -  Pi(ir,)  +  Pk(ir,)  * 
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Since  R^  _>  ,  it  follows  from  the  above  that 

PjU)^  +  P^iOR^  1  P1(ir')R1  +  Pk(7r')Rk  . 

According  to  Theorem  1,  all  the  jobs  scheduled  after  jobs  1  and  k 
start  their  execution  stochastically  earlier  under  schedule  n'  . 

Therefore,  the  probability  of  each  of  these  jobs  being  successfully 
performed  is  larger  under  it'  .  Thus,  interchanging  job  k  and  job  1 
increases  the  total  expected  reward.  So  it  is  clear  that  in  any  case 
the  original  schedule  could  not  be  optimal. 

If  the  schedule  is  not  1,2,  . ..,  n  we  always  will  be  able  to 
find  a  job  with  a  reward  bigger  than  each  of  the  jobs  following  it 
and  the  one  preceding  it.  Performing  a  pairwise  switch  increases  the 
total  expected  reward. | ) 

One  remark  should  be  made  here.  It  is  not  necessarily  true  that 

if  v(t)  is  increasing,  then  the  optimal  schedule  is  to  do  jobs  in 

decreasing  value  of  R  .  To  obtain  a  counterexample,  suppose  that 

A.R,  *  A.R.  for  all  i  ,  j  .  Hence,  from  Lemma  2  and  Theorem  1,  it  follows 
i  i  j  j 

that  the  optimal  policy  is  to  schedule  jobs  in  decreasing  order  of  A^  ;  and 
therefore,  all  policies  are  not  equivalent  as  would  be  the  case  if  the  con¬ 
jecture  were  true. 

We  now  consider  the  case  v(t)  decreasing. 

Theorem  4: 

If  v(t)  is  decreasing  and  if  R^  and  A^R^  are  increasing  and 
A  is  decreasing,  then  1,2,  ...,  n  is  the  optimal  schedule. 


[ 

L* 
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Proof ; 

The  proof  is  similar  to  Che  proof  of  Case  2  In  Theorem  3. | | 

Again,  In  this  case,  schedule  1,2,  . ...  n  Is  not  necessarily 
optimal  under  weaker  sufficient  conditions.  Counterexamples  can  be 
found  easily. 
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